Incorporating Behavioral Constraints in Online AI Systems

AI systems that learn through reward feedback about the actions they take are increasingly deployed in domains that have significant impact on our daily life. However, in many cases the online rewards should not be the only guiding criteria, as there are additional constraints and/or priorities imposed by regulations, values, preferences, or ethical principles. We detail a novel online agent that learns a set of behavioral constraints by observation and uses these learned constraints as a guide when making decisions in an online setting while still being reactive to reward feedback. To define this agent, we propose to adopt a novel extension to the classical contextual multi-armed bandit setting and we provide a new algorithm called Behavior Constrained Thompson Sampling (BCTS) that allows for online learning while obeying exogenous constraints. Our agent learns a constrained policy that implements the observed behavioral constraints demonstrated by a teacher agent, and then uses this constrained policy to guide the reward-based online exploration and exploitation. We characterize the upper bound on the expected regret of the contextual bandit algorithm that underlies our agent and provide a case study with real world data in two application domains. Our experiments show that the designed agent is able to act within the set of behavior constraints without significantly degrading its overall reward performance.Comment: 9 pages, 6 figure

Infusing Knowledge into the Textual Entailment Task Using Graph Convolutional Networks

Textual entailment is a fundamental task in natural language processing. Most approaches for solving the problem use only the textual content present in training data. A few approaches have shown that information from external knowledge sources like knowledge graphs (KGs) can add value, in addition to the textual content, by providing background knowledge that may be critical for a task. However, the proposed models do not fully exploit the information in the usually large and noisy KGs, and it is not clear how it can be effectively encoded to be useful for entailment. We present an approach that complements text-based entailment models with information from KGs by (1) using Personalized PageR- ank to generate contextual subgraphs with reduced noise and (2) encoding these subgraphs using graph convolutional networks to capture KG structure. Our technique extends the capability of text models exploiting structural and semantic information found in KGs. We evaluate our approach on multiple textual entailment datasets and show that the use of external knowledge helps improve prediction accuracy. This is particularly evident in the challenging BreakingNLI dataset, where we see an absolute improvement of 5-20% over multiple text-based entailment models

Cerebral venous sinus thrombosis due to vaccine-induced immune thrombotic thrombocytopenia in middle-income countries

Background: Adenovirus-based COVID-19 vaccines are extensively used in low- and middle-income countries (LMICs). Remarkably, cases of cerebral venous sinus thrombosis due to vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) have rarely been reported from LMICs. Aims: We studied the frequency, manifestations, treatment, and outcomes of CVST-VITT in LMICs. Methods: We report data from an international registry on CVST after COVID-19 vaccination. VITT was classified according to the Pavord criteria. We compared CVST-VITT cases from LMICs to cases from high-income countries (HICs). Results: Until August 2022, 228 CVST cases were reported, of which 63 were from LMICs (all middle-income countries [MICs]: Brazil, China, India, Iran, Mexico, Pakistan, Turkey). Of these 63, 32 (51%) met the VITT criteria, compared to 103 of 165 (62%) from HICs. Only 5 of the 32 (16%) CVST-VITT cases from MICs had definite VITT, mostly because anti-platelet factor 4 antibodies were often not tested. The median age was 26 (interquartile range [IQR] 20–37) versus 47 (IQR 32–58) years, and the proportion of women was 25 of 32 (78%) versus 77 of 103 (75%) in MICs versus HICs, respectively. Patients from MICs were diagnosed later than patients from HICs (1/32 [3%] vs. 65/103 [63%] diagnosed before May 2021). Clinical manifestations, including intracranial hemorrhage, were largely similar as was intravenous immunoglobulin use. In-hospital mortality was lower in MICs (7/31 [23%, 95% confidence interval (CI) 11–40]) than in HICs (44/102 [43%, 95% CI 34–53], p = 0.039). Conclusions: The number of CVST-VITT cases reported from LMICs was small despite the widespread use of adenoviral vaccines. Clinical manifestations and treatment of CVST-VITT cases were largely similar in MICs and HICs, while mortality was lower in patients from MICs.</p

Sex differences in cerebral venous sinus thrombosis after adenoviral vaccination against COVID-19

Introduction: Cerebral venous sinus thrombosis associated with vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) is a severe disease with high mortality. There are few data on sex differences in CVST-VITT. The aim of our study was to investigate the differences in presentation, treatment, clinical course, complications, and outcome of CVST-VITT between women and men. Patients and methods: We used data from an ongoing international registry on CVST-VITT. VITT was diagnosed according to the Pavord criteria. We compared the characteristics of CVST-VITT in women and men. Results: Of 133 patients with possible, probable, or definite CVST-VITT, 102 (77%) were women. Women were slightly younger [median age 42 (IQR 28–54) vs 45 (28–56)], presented more often with coma (26% vs 10%) and had a lower platelet count at presentation [median (IQR) 50x109/L (28–79) vs 68 (30–125)] than men. The nadir platelet count was lower in women [median (IQR) 34 (19–62) vs 53 (20–92)]. More women received endovascular treatment than men (15% vs 6%). Rates of treatment with intravenous immunoglobulins were similar (63% vs 66%), as were new venous thromboembolic events (14% vs 14%) and major bleeding complications (30% vs 20%). Rates of good functional outcome (modified Rankin Scale 0-2, 42% vs 45%) and in-hospital death (39% vs 41%) did not differ. Discussion and conclusions: Three quarters of CVST-VITT patients in this study were women. Women were more severely affected at presentation, but clinical course and outcome did not differ between women and men. VITT-specific treatments were overall similar, but more women received endovascular treatment.</p

Measuring routine childhood vaccination coverage in 204 countries and territories, 1980-2019 : a systematic analysis for the Global Burden of Disease Study 2020, Release 1

Background Measuring routine childhood vaccination is crucial to inform global vaccine policies and programme implementation, and to track progress towards targets set by the Global Vaccine Action Plan (GVAP) and Immunization Agenda 2030. Robust estimates of routine vaccine coverage are needed to identify past successes and persistent vulnerabilities. Drawing from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2020, Release 1, we did a systematic analysis of global, regional, and national vaccine coverage trends using a statistical framework, by vaccine and over time. Methods For this analysis we collated 55 326 country-specific, cohort-specific, year-specific, vaccine-specific, and dosespecific observations of routine childhood vaccination coverage between 1980 and 2019. Using spatiotemporal Gaussian process regression, we produced location-specific and year-specific estimates of 11 routine childhood vaccine coverage indicators for 204 countries and territories from 1980 to 2019, adjusting for biases in countryreported data and reflecting reported stockouts and supply disruptions. We analysed global and regional trends in coverage and numbers of zero-dose children (defined as those who never received a diphtheria-tetanus-pertussis [DTP] vaccine dose), progress towards GVAP targets, and the relationship between vaccine coverage and sociodemographic development. Findings By 2019, global coverage of third-dose DTP (DTP3; 81.6% [95% uncertainty interval 80.4-82 .7]) more than doubled from levels estimated in 1980 (39.9% [37.5-42.1]), as did global coverage of the first-dose measles-containing vaccine (MCV1; from 38.5% [35.4-41.3] in 1980 to 83.6% [82.3-84.8] in 2019). Third- dose polio vaccine (Pol3) coverage also increased, from 42.6% (41.4-44.1) in 1980 to 79.8% (78.4-81.1) in 2019, and global coverage of newer vaccines increased rapidly between 2000 and 2019. The global number of zero-dose children fell by nearly 75% between 1980 and 2019, from 56.8 million (52.6-60. 9) to 14.5 million (13.4-15.9). However, over the past decade, global vaccine coverage broadly plateaued; 94 countries and territories recorded decreasing DTP3 coverage since 2010. Only 11 countries and territories were estimated to have reached the national GVAP target of at least 90% coverage for all assessed vaccines in 2019. Interpretation After achieving large gains in childhood vaccine coverage worldwide, in much of the world this progress was stalled or reversed from 2010 to 2019. These findings underscore the importance of revisiting routine immunisation strategies and programmatic approaches, recentring service delivery around equity and underserved populations. Strengthening vaccine data and monitoring systems is crucial to these pursuits, now and through to 2030, to ensure that all children have access to, and can benefit from, lifesaving vaccines. Copyright (C) 2021 The Author(s). Published by Elsevier Ltd.Peer reviewe

Cancer Incidence, Mortality, Years of Life Lost, Years Lived With Disability, and Disability-Adjusted Life Years for 29 Cancer Groups From 2010 to 2019: A Systematic Analysis for the Global Burden of Disease Study 2019.

The Global Burden of Diseases, Injuries, and Risk Factors Study 2019 (GBD 2019) provided systematic estimates of incidence, morbidity, and mortality to inform local and international efforts toward reducing cancer burden. To estimate cancer burden and trends globally for 204 countries and territories and by Sociodemographic Index (SDI) quintiles from 2010 to 2019. The GBD 2019 estimation methods were used to describe cancer incidence, mortality, years lived with disability, years of life lost, and disability-adjusted life years (DALYs) in 2019 and over the past decade. Estimates are also provided by quintiles of the SDI, a composite measure of educational attainment, income per capita, and total fertility rate for those younger than 25 years. Estimates include 95% uncertainty intervals (UIs). In 2019, there were an estimated 23.6 million (95% UI, 22.2-24.9 million) new cancer cases (17.2 million when excluding nonmelanoma skin cancer) and 10.0 million (95% UI, 9.36-10.6 million) cancer deaths globally, with an estimated 250 million (235-264 million) DALYs due to cancer. Since 2010, these represented a 26.3% (95% UI, 20.3%-32.3%) increase in new cases, a 20.9% (95% UI, 14.2%-27.6%) increase in deaths, and a 16.0% (95% UI, 9.3%-22.8%) increase in DALYs. Among 22 groups of diseases and injuries in the GBD 2019 study, cancer was second only to cardiovascular diseases for the number of deaths, years of life lost, and DALYs globally in 2019. Cancer burden differed across SDI quintiles. The proportion of years lived with disability that contributed to DALYs increased with SDI, ranging from 1.4% (1.1%-1.8%) in the low SDI quintile to 5.7% (4.2%-7.1%) in the high SDI quintile. While the high SDI quintile had the highest number of new cases in 2019, the middle SDI quintile had the highest number of cancer deaths and DALYs. From 2010 to 2019, the largest percentage increase in the numbers of cases and deaths occurred in the low and low-middle SDI quintiles. The results of this systematic analysis suggest that the global burden of cancer is substantial and growing, with burden differing by SDI. These results provide comprehensive and comparable estimates that can potentially inform efforts toward equitable cancer control around the world.Funding/Support: The Institute for Health Metrics and Evaluation received funding from the Bill & Melinda Gates Foundation and the American Lebanese Syrian Associated Charities. Dr Aljunid acknowledges the Department of Health Policy and Management of Kuwait University and the International Centre for Casemix and Clinical Coding, National University of Malaysia for the approval and support to participate in this research project. Dr Bhaskar acknowledges institutional support from the NSW Ministry of Health and NSW Health Pathology. Dr Bärnighausen was supported by the Alexander von Humboldt Foundation through the Alexander von Humboldt Professor award, which is funded by the German Federal Ministry of Education and Research. Dr Braithwaite acknowledges funding from the National Institutes of Health/ National Cancer Institute. Dr Conde acknowledges financial support from the European Research Council ERC Starting Grant agreement No 848325. Dr Costa acknowledges her grant (SFRH/BHD/110001/2015), received by Portuguese national funds through Fundação para a Ciência e Tecnologia, IP under the Norma Transitória grant DL57/2016/CP1334/CT0006. Dr Ghith acknowledges support from a grant from Novo Nordisk Foundation (NNF16OC0021856). Dr Glasbey is supported by a National Institute of Health Research Doctoral Research Fellowship. Dr Vivek Kumar Gupta acknowledges funding support from National Health and Medical Research Council Australia. Dr Haque thanks Jazan University, Saudi Arabia for providing access to the Saudi Digital Library for this research study. Drs Herteliu, Pana, and Ausloos are partially supported by a grant of the Romanian National Authority for Scientific Research and Innovation, CNDS-UEFISCDI, project number PN-III-P4-ID-PCCF-2016-0084. Dr Hugo received support from the Higher Education Improvement Coordination of the Brazilian Ministry of Education for a sabbatical period at the Institute for Health Metrics and Evaluation, between September 2019 and August 2020. Dr Sheikh Mohammed Shariful Islam acknowledges funding by a National Heart Foundation of Australia Fellowship and National Health and Medical Research Council Emerging Leadership Fellowship. Dr Jakovljevic acknowledges support through grant OI 175014 of the Ministry of Education Science and Technological Development of the Republic of Serbia. Dr Katikireddi acknowledges funding from a NHS Research Scotland Senior Clinical Fellowship (SCAF/15/02), the Medical Research Council (MC_UU_00022/2), and the Scottish Government Chief Scientist Office (SPHSU17). Dr Md Nuruzzaman Khan acknowledges the support of Jatiya Kabi Kazi Nazrul Islam University, Bangladesh. Dr Yun Jin Kim was supported by the Research Management Centre, Xiamen University Malaysia (XMUMRF/2020-C6/ITCM/0004). Dr Koulmane Laxminarayana acknowledges institutional support from Manipal Academy of Higher Education. Dr Landires is a member of the Sistema Nacional de Investigación, which is supported by Panama’s Secretaría Nacional de Ciencia, Tecnología e Innovación. Dr Loureiro was supported by national funds through Fundação para a Ciência e Tecnologia under the Scientific Employment Stimulus–Institutional Call (CEECINST/00049/2018). Dr Molokhia is supported by the National Institute for Health Research Biomedical Research Center at Guy’s and St Thomas’ National Health Service Foundation Trust and King’s College London. Dr Moosavi appreciates NIGEB's support. Dr Pati acknowledges support from the SIAN Institute, Association for Biodiversity Conservation & Research. Dr Rakovac acknowledges a grant from the government of the Russian Federation in the context of World Health Organization Noncommunicable Diseases Office. Dr Samy was supported by a fellowship from the Egyptian Fulbright Mission Program. Dr Sheikh acknowledges support from Health Data Research UK. Drs Adithi Shetty and Unnikrishnan acknowledge support given by Kasturba Medical College, Mangalore, Manipal Academy of Higher Education. Dr Pavanchand H. Shetty acknowledges Manipal Academy of Higher Education for their research support. Dr Diego Augusto Santos Silva was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil Finance Code 001 and is supported in part by CNPq (302028/2018-8). Dr Zhu acknowledges the Cancer Prevention and Research Institute of Texas grant RP210042